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DETAILED ACTION 



Response to Arguments 

1. Applicant's arguments with respect to elected independent Claims 1 and 22 have been 
considered, but are moot in view of the new grounds of rejection. 

2. Although, Applicant argues the Examiner has merely asserted that Claim 3 1 is readable 
on the non-elected species of Figure 10 and has not established the required burden. Applicant 
also newly adds independent Claim 32 and argues that the claim corresponds to amended 
independent Claim 22, but is directed to a computer program product. 

3. The Examiner respectfully disagrees with Applicant's position. The Examiner maintains 
that Claim 31 requires the "modules" shown in nonelected species of Figure 10. Additionally, 
the Examiner submits new Claim 32 requires the computer program product discussed on page 
34 (lines 13 - 27), also in regards to nonelected species of Figure 10. 

4. According to MPEP §808.02, in order to establish the required burden, the Examiner 
must show one of the following: separate classification thereof; a separate status in the art when 
they are classifiable together; and a different field of search. 

5. In the case of Claims 31 and 32, a different field of search is required. The "modules" 
and "computer program producf of the nonelected species of Figure 10 would at least require a 
search in Class 717 - Subclass 107 (component based software development/management), 
which is different than the search in Class 348 - Subclass 169 (object searching/tracking) that is 
required for the species of Figures 1-5 and Claims 1 and 22. Accordingly, Claims 31 and 32 
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are withdrawn from further consideration pursuant to 37 CFR 1.142(b), as being drawn to a 
nonelected species, there being no allowable generic or linking claim. 

Claim Rejections - 35 USC § 103 

6. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

7. Claims 1 - 3, 5 - 10, 14, 22 - 26, and 30 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Lyons (US 6 734 91 1 Bl) in view of Anderson (US 7 106 376 Bl). 

The Examiner believes independent Claims 1 and 22 are corresponding apparatus and 
method claims, respectively. Accordingly, they will be rejected together. 

8. For Claims 1 and 22, Lyons discloses, as shovra in figures 1 A, 2A, 2B, 3 A, 4A, 5 A, 7A, 

9. 1 1, and 12, an image processing apparatus (14 - figure lA), comprising: 

an image data input unit (17) for inputting image data (28) of a plurality of objects (21, 
21a, 22, and 23) including a main subject (21); 

a range setting unit (15) for restricting a searching range in the depth direction ("narrow- 
angle field of view"; see column 11, line 61 - column 12, line 20; Lyons clearly shows that the 
search range is restricted to a single predetermined distance from the image data input unit to the 
plurality of objects.) for searching said main subject (21) from the plurahty of objects (21, 21a, 
22, and 23) using the input image data (28); and 
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a partial image extracting unit (15/222) for extracting a partial image ("central region 
26") including said main subject (21) from said image data, a depth direction of said partial 
image being restricted to said searching range set by said range setting unit (see column 7, lines 
55 -65 and column 8, line 1 1 - 22). 

While Lyons discloses restricting the searching range to a single predetermined distance 
in the depth direction for search a main subject from the plurality of objects; Lyons is silent with 
respect to extracting the main subject from the image data based on depth distribution 
information indicating a distance to each of said plurality of objects included in said image data. 

On the other hand, Anderson also discloses an image processing apparatus including a 
range setting unit and an image extracting unit for extracting said main subject from within the 
set searching range. Specifically, Anderson teach, as shown in figures 1, 3 A, 3B, 4B, an image 
processing apparatus including a range setting unit and an image extracting unit for extracting 
said main subject (e.g., 504) from among a plurality of objects (e.g., 502, 508, and 506) from 
within the set searching range (500). Anderson further teaches, as shown in figure 7 and as 
stated in column 8 (line 1) - column 9 (line 57), extracting the main subject (504) from the 
image data (500) based on depth distribution information (see figure 6A) indicating a distance to 
each of said plurality of objects included in said image data (see column 8,lines 1-13). 

At the time invention was made, it would have been obvious to one with ordinary skill in 
the art to have included the extracting the main subject from the image data based on depth 
distribution information indicating a distance to each of said plurality of objects included in said 
image data (as taught by Anderson) in the image processing apparatus (disclosed by Lyons) for 
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the advantage of reducing undesirable image characteristics and improve image quality (see 
column 1, lines 61 and 62). 

9. As for Claim 2, Lyons discloses, as shown in figure 1 A, wherein said image data input 
unit comprises a means for inputting a parallactic image ("different focal lengths in the radial 
and tangential planes"; see column 5, lines 53 - 57), which picks up an image of the plurality of 
objects (21,21a, 22, and 23) from a plurality of different perspectives, and the image processing 
apparatus (222) further comprises a depth distribution information receiving unit for receiving 
said depth distribution information based on said parallactic image (28). 

10. As for Claim 3, Lyons discloses, as stated in columns 7 (lines 55 - 65) and 8 (lines 1 1 - 
22) further comprising a main subject detecting unit (15/222) for detecting a main subject (21) 
from said partial image ("central region 26") and receiving main subject information. 

IL As for Claims 5 and 23, Lyons discloses, as shown in figures 1 1 and 12 and as stated in 
column 1 1 (line 61) - 12 (lines 20), said range setting unit (15) comprises a means for setting a 
first searching range ("narrow-angle field of view") and a means for setting a second searching 
range ("wide-angle setting"), which differs from said first searching range; 

said partial image extracting unit (15/222) comprises a means for extracting the part of 
the plurality of objects (21, 21a, 22, and 23) included in said first searching range (Step S125) as 
a partial image and a means for extracting the part the plurality of objects (21,21a, 22, and 23) 
included in said second searching range (Step SI 23) as a second partial image (Steps SI 23 and 
SI 25 indicate the part of the plurality of objects (21,21a, 22, and 23) is included in both 
searching ranges,); and 
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said main subject detecting unit (15/222) comprises a means for detecting (Step SI 22) 
said main subject (21) from said first partial image and a means for detecting (Step SI 22) said 
main subject (21) from said second partial image when said main subject is not detected from 
said first partial image (see figure 12). 

12. As for Claim 6, Lyons discloses, as shown in figures 1 1 and 12, wherein said range 
setting unit (15) sets a predetermined depth length ("narrow-angle field of view") as said first 
searching range and sets the depth length contiguous (see column 12, lines 10 - 20) to said first 
searching range as said second searching range ("wide-angle"). 

13. As for Claims 7, 8, 24, and 25, Lyons discloses, as shown in figures 1 1 and 12 and as 
stated in column 5 (lines 52 - 57), wherein said range setting unit (15) sets the depth length 
("narrow-angle field of view"), which includes an independent object (21) existing at the nearest 
distance (i.e., zoomed-in), as said first searching range based on a depth distribution information 
(see column 5, lines 52-57) and sets the depth length contiguous to said first searching range as 
said second searching range (see figure 12). 

14. As for Claim 9, Lyons discloses, as shown in figures 1 1 and 12, said range setting unit 
(15) sets a different said searching range (Step SI 23) when said main subject is not detected 
(Step SI 22) in said searching range set by said range setting unit (15); said partial image 
extracting unit extracts again (Steps SI 24) said partial image; and detects again said main 
subject. 

15. As for Claims 10 and 26, Lyons discloses, as shown in figures 1 1 and 12 and as stated in 
column 1 1 (line 61) - 12 (lines 20), wherein said image data input unit is an image capturing unit 
(17/51) for picking up an image of the plurality of objects (21, 21a, 22, and 23), comprising: a 
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photographic condition setting unit (67) for setting a photographic condition (zoom condition) 
based on said main subject information; and an image capturing control unit for controlling 
imaging by said image capturing unit based on said photographic condition (see figure 12). 

16. As for Claims 14 and 30, Lyons inherently discloses wherein said image data input unit 
is an image capturing unit, which captures an image of said object based on a photographic 
timing signal. However, Lyons is silent with respect to setting a photographic timing condition 
relating to the main subject, wherein said photographic timing is predetermined and stored. 

However, Official Notice (MPEP § 2144.03) is taken that both the concepts and 
advantages of providing a timing condition storing unit for storing a predetermined photographic 
timing condition relating to said main subject; and a timing signal output unit for outputting said 
photographic timing signal to said image capturing unit when said main subject satisfies said 
photographic timing condition are well known and expected in the art. At the time the invention 
was made, it would have been obvious to one with ordinary skill in the art to have a timing 
condition storing unit for storing a predetermined photographic timing condition relating to said 
main subject; and a timing signal output unit for outputting said photographic timing signal to 
said image capturing unit when said main subject satisfies said photographic timing condition for 
the advantage optimizing exposure and dynamic range of the main subject, 

17. Claim 4 is rejected under 35 U.S.C. 103(a) as being unpatentable over Lyons in view of 
Anderson in further view of Hanna et al. (US 6 714 665 Bl). 
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18. As for Claim 4, Lyons (as modified by Anderson) discloses a main subject detecting unit 
(15/222) for detecting a main subject (21) from said partial image ("central region 26") and 
receiving main subject information. 

However, Lyons (as modified by Anderson) does not disclose a distinctive parts detecting 
unit for detecting from said partial image, a distinctive part, which should be included in said 
main subject; and an information receiving unit for receiving said main subject information 
based on the position of said distinctive part detected by said distinctive parts detecting unit. 

On the other hand, Hanna et al. also disclose an image processing apparatus including an 
image data input unit, a range setting unit, and a partial image extracting unit. Mores 
specifically, Hanna et al teach, as shown in figures 1 A and IB, a distinctive parts detecting unit 
(computer 20) for detecting from said partial image (NFOV camera 14), a distinctive part 
("user's eye" - see figure IB), which should be included in said main subject; and an 
information receiving unit (18) for receiving said main subject information based on the position 
of said distinctive part detected by said distinctive parts detecting unit (see column 5, lines 40 - 
51 and column 7, lines 17 - 30). 

As stated in column 1 (lines 50 - 53) of Hanna et al., at the time the invention was made, 
it would have been obvious to one with ordinary skill in the art to have included a distinctive 
pars detecting unit and an information receiving unit (as taught by Hanna et al.) in the image 
processing apparatus (disclosed by Lyons - as modified by Anderson), for the advantage 
"identifying objects of individuals in a passive way that is both fast and accurate." 
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Conclusion 

19. Applicant's amendment necessitated the new ground(s) of rejection presented in this 
Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). 
Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
v^ill expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1.136(a) v^ill be calculated fi'om the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the date of this 
final action. 

20. Any inquiry concerning this communication or earlier communications from the 
Examiner should be directed to Justin P Misleh whose telephone number is 571.272.7313. The 
Examiner can normally be reached on Monday through Friday from 8:00 AM to 5:00 PM. 

If attempts to reach the Examiner by telephone are unsuccessfiil, the Examiner's 
supervisor, Vivek Srivastava can be reached on 571.272.7304. The fax phone number for the 
organization where this application or proceeding is assigned is 571.273.3000. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
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system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 

JPM 

October 30, 2006 ^ 
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